Correlations and Synchrony in Threshold Neuron Models 
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We study how threshold model neurons transfer temporal and interneuronal input correlations to 
correlations of spikes. We find that the low common input regime is governed by firing rate dependent 
spike correlations which are sensitive to the detailed structure of input correlation functions. In 
the high common input regime the spike correlations are insensitive to the firing rate and exhibit a 
universal peak shape independent of input correlations. Rate heterogeneous pairs driven by common 
inputs in general exhibit asymmetric spike correlations. 
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Neurons in the CNS exhibit temporally correlated ac- 
tivity that can reflect specific features of sensory stim- 
uli or behavioral tasks [H, Recently, the origin, sta- 
tistical structure and coding properties of spike corre- 
lations in neuronal systems have attracted substantial 
attention [1, 0, How do neurons transfer correlated 
inputs into correlated output? This fundamental ques- 
tion is vital to understand the structure of netvifork cor- 
relations, yet it is unansv^^ered. In the past, most theo- 
retical analyses addressing this question utilized coupled 
stochastic differential equations and the Fokker Planck 
formalism 0, Q . These approaches are technically very 
demanding and are therefore practically restricted to sim- 
ple stochastic processes, see e.g. As a result, explicit 
expressions for quantities of interest are often lacking or 
obtainable only in special limiting cases. 
Here we show that an alternative modeling framework, 
based on the theory of smooth random functions 0, , 
can provide a mathematically transparent and highly 
tractable description of spike correlations driven by in- 
puts of arbitrary temporal structure and correlation 
strength. Our theoretical findings may find applications 
beyond neuroscience, e.g. in spin ordering, reliability 
studies, as the statistics of (upward) level crossings is 
a general, long standing problem in physics and engi- 
neering [9|]. We calculate quantities which have so far 
escaped a theoretical description by competing Fokker- 
Planck based formalism: 1) peak spike correlation for 
arbitrary input correlation strength, 2) rate independent 
peak shape in the high correlation regime, 3) complete 
spike correlation function for weak correlations, 4) asym- 
metric spike correlation function in rate inhomogeneous 
pairs. A priori, the simple threshold model we use cannot 
be expected to completely capture the complex behavior 
of cortical neurons. Remarkably, our results reproduce 
and extend previous reports on the firing rate depen- 
dence of cortical spike correlations [1,^]. Furthermore, 
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FIG. 1: (A) Paradigm of two fluctuating current traces 
which share a component nc and have a correlation strength 
r(r > 0). The correlated currents are injected successively 
into neurons. (B) MP traces of two neurons (red and blue) 
recorded in response to correlated fluctuating current with 
r « 1 and r ~ 0.3. In all four recordings v ~ 5Hz, rs=20ms 
and Ci{t) as in Egs. I1I4I spikes are truncated at — lOmV 



we were able to qualitatively confirm all new predictions 
in our in vitro experiments. 
Framework- We model the membrane potential (MP) of 
a neuron by a temporally continuous, stationary Gaus- 
sian random function V{t) with temporal correlation 
C{t)={V{0)V{t)) and zero mean, which we term Gaus- 
sian Pseudo Potentials (GPPs); (•) denotes the ensemble 
average. Assuming a simple leaky integrator model with 
a membrane time constant tm, TMV{t)=—V{t) -\- ^(i). 
The voltage and current statistics are linked by: 



C/(cj) = C(cj)(l + 
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(1) 



where Ci{t) denotes the current correlation function 
and C/(w) its Fourier transform. To induce correla- 
tions we use common input. Two correlated currents 
i = 1j2 (1 and 2 denote noise input to neurons 1 
and 2) are derived from three statistically independent 
temporally correlated Gaussian processes ni,n2,nc with 
current correlation function C/ (r) : 



£,j{t) = ^/l-rn.J{t) + ^/fn,(^). 



(2) 



rij are the individual noise components (as in Fig.[l](A)) 
and Tie the shared component. Vj and Uj can be related 
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using the membrane filter in Eq. [TJ The corresponding 
correlated voltages Vi , V2 mimic the neuronal traces of 
two neurons subject to common input, r modulates be- 
tween full synchrony and asynchrony, 0<r<l. 
Model spike statistics- The simplest conceivable model 
of spike generation from a fluctuating MP identifies the 
spike times with upward threshold crossings of V{t). The 
spike times tj are then given by the spike measure 

s{t) = 5] <5(i - t,) = S{V{t) ^Jo)\V{t)\9{V{t)), (3) 

where V'o is the distance to threshold relative to {V{0)), 
5{-) and 9{-) are the Dirac delta and Heaviside theta func- 
tions, respectively. In contrast to the classical integrate- 
and-fire (IF) model this model has no reset [?[ but ex- 
hibits an intrinsic silence period after a spike. We as- 
sume a smooth C(t) such that the variance {V{t)V{t)) — 
— C"(0) exist and V{t) has a finite rate of thresh- 
old crossings. The differential correlation time = 
■\/C(0)/|C"(0)| describes the decay of the correlation 
function near t—0. For numerical simulations and exper- 
imental testing we choose the following selfcharacteristic, 
exponentially decaying correlation function: 

c(r) = l/cosh(T/r,), {V{t)V{t + t)) ^ ai.c{T). (4) 

However, most results are independent of the particular 
shape of C(t). All spike correlations between two neu- 
rons can be obtained via the covariance matrix C and the 
joint probability density of T?=Vi(0), Vi(0), ^2(1"), F2(t) 
p{V)=cxp{-V^C-^V/2)/{4TT^V'^5etC) where 
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Here €[2 (t) and Cfg (r) denote the first and second tem- 
poral derivative of Ci_2(t), respectively. Note that Eq. [5] 
implies that all pairwise correlations can be expressed 
as a functional of Ci2(t), C(2(t), C"2(t). Voltage cross 
correlation function Ci2(t) is: 



C^12(t) - {Vi{0)V2{t)) = rav.cTvAr)- 



(6) 



The firing rate {s{t)) of one neuron is then: 

V = {s{t)) = exp(-Vo/(2a^))/(2^T,) (7) 

The firing rate in Eq. [7] depends only on two parame- 
ters: the correlation time and the threshold-to-variance 
ratio ipQ/ay, but not on the specific choice of the cor- 
relation function Hence, processes with the same 
Ts but different form of C(t) will have the same de- 
spite different temporal spike statistics. The threshold- 
to-variance ratio basically determines the probability of 
threshold crossings. A decrease in ipo/av leads to an in- 
crease in v. Injections of constant currents shift the mean 



potential and thus decrease the distance to threshold ipo 
resulting in a higher v. v is also increasing with decreas- 
ing Ts, because faster fiuctuations lead to higher rate of 
threshold crossings. This model has a maximal firing 
rate v — Xj (2'kTs), which corresponds to the upward zero 
crossings of the random process. It should therefore be 
used in the fluctuation driven, low firing rate i'<i> regime 
which is prevalent in cortical neurons [6|. 
Experimental test- To access spike correlations in real 
neurons in vitro, we made whole-cell recordings from 
layer 2/3 pyramidal neurons (7V=19) in neocortical slices 
from rats (PND 22-27). Correlated inputs to neurons 
were mimicked by injection of digitally synthesized sets 
of fluctuating currents with Ci{t) fEas. lll4( ). varying the 
correlation parameter (r S {0.3, 1}), and time constants 
TM=20ms, Ts={20, lOOjms. Correlated currents were 
generated by specifying the Fourier spectrum and trans- 
ferring to the time domain as described in [§], such that 
the voltage correlation function C (r) of the neurons was 
similar to the model correlation function (Eq.[4]). During 
the recording (10s or 5s episodes), we targeted two dif- 
ferent firing rates z/i=5Hz (Ti = 10s), iy2 = 10Hz (r2=5s), 
by injection of an additional constant current. The aver- 
age firing rate obtained is denoted by Vm- We obtained 
a total of iV=281 recordings for i^i, N=299 recordings 
for 1^2- For identical noise injection (^=1) we recorded 
A^=80 at the target rate vi, A^=81 at 1/2, and A^=21 at 
a target rate of 3Hz {Ts=Ti). Fig. [T] shows examples of 
recorded voltage traces for large and small r. We calcu- 
lated Vcondi'r) using a Gaussian filter kernel with CT=5ms 
and 95% Jackknife confidence intervalls for N random 
subsamples each containing N /2 recordings. Experimen- 
tal results are compared with model predictions in high 
and low correlation regimes. 
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FIG. 2: Simulated and analytical spike cross correlations of 
two correlated neurons (!/i=//2). (A) !/conii(0) vs. rasinEq.|9l 
Vcond(Q) for a fixed r3=10ms and //=0.1Hz(red), ;/=lHz(blue), 
!/=10Hz(black). (inset) UcondiQ) for a fixed j^=5Hz and 
Ts = 10ms(red), rs=5ms(blue), 1ms (black). Circles denote 
simulated results. (B) g{Q) vs. v for fixed Ts and small r. In 
red Umax and gmax, simulation results from (C) are shown as 
corresponding symbols. (C) rgij) vs. r as in Eq. ll2l and sim- 
ulated results for r=0.05 (left) 1^=15, 3, IHz, Ts^lOms. (right) 
T,=5, 10, 20ms, i/=5Hz. 
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Spike correlations- To quantify the temporal spike cross 
correlations between neuron 1 and 2 we used the con- 
ditional firing rate Vcondij), which is the firing rate of 
neuron 2 triggered on the spikes of neuron f : 



(8) 



This quantity measures correlations on all time scales 
and is equivalent to the spike count correlation coeffi- 
cient p {p~T{vcond{^)—i^y) for small time bin T. For a 
pair of identical neurons VcondiT) is a symmetrical func- 
tion which approaches v as t increases and maximally 
deviates from v at t=0. We obtain Vcond{Q) by solving 
the Gaussian integrals in Eq. l3l5l for any r: 



,<i(0) 



2r arctan(vi? 



l-r2], (9) 



where R— (1 — r)/(l + r). Eq. [9] predicts a superhnear 
increase of z^conci(O) with r, see Fig.[2][A). 
Strong cross correlations rwl- In this limit we find that 
the peak spike correlations are independent of v and of 
the particular shape of Ci2(t). 



l^condiO) ~ l/(2%/2VT^T,) 



(r«l) (10) 



Do these predictions hold for neuronal spike correlations? 
Fig.[3](left) depicts recorded i'cond(T) in the high r regime 
for different firing rates. The correlation peaks for 3, 5.3 
and 8.5Hz are essentially identical (Fig. [3] (left)). These 
recordings confirm the prediction that the amplitude is 
insensitive to the firing rate. Additionally, the peak form 
suggests that there is a rate independent universal corre- 
lation peak shape. To assess this possibility theoretically, 
we calculate I'condi'r) by solving the Gaussian integrals in 
Ea. l3l5l for r « 1 and r ^ r^. We obtain: 

vcondir) = 1/(2t;)(1 - 3/2f2 + 30/16f4) + 0(r<') (11) 



where t=t/t* with the time constant t*—^/2^1 — rTg. 
For r = 1 the 5-peak present at the origin of the auto 
conditional firing rate is recovered. Eg. I 111 indeed demon- 
states the existence of a rate independent universal peak 
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FIG. 3: Firing rate independence of spike correlations for 
strong input correlations, theory and experiment. (left) 
Vcondij) VS. r calculated for identical current injections 
in recorded neurons, (right) Vcond{T) for simulated pair of 
neurons for — 3Hz (black) and i^2=6Hz (blue), 12.5 < 
VT^Ts<l2.8 with 20 <Ts< 25ms and 0.59<r<0.75. The 
overlap of both families of curves is plotted in red. 



shape and height, determined by t^. Note, that Eq. [TT] 
predicts that correlation peak shape is insensitive to the 
functional form of Ci2(t). To explore how close the 
agreement between theory and experiment is, we com- 
puted Vcond(j) from simulated pairs and found a good 
qualitative agreement with experimental findings for a 
broad range of parameters. The salient correlation peak 
structure can be faithfully reproduced by our framework 
and the additional weak periodic modulation of the ex- 
perimental stationary rates might be due to additional 
ion conductances of real neurons. The width and hight 
of the common peak can be qualitatively described by the 
theoretical curves in Fig. [3] (right). We note, that r«0.7 
in the simulations and in the experiments (0.6<r< 0.9) 
were similar and both were close to the typical corre- 
lation coefficient {p « 0.6 for time bin 40ms) reported 
recently for cell pairs subject to identical white noise cur- 
rents [Fig. Id in [5]]. 

Low correlation strength- In this limit, VcondiT) recov- 
ers the rate dependence and shows sensitivity to c(t). 
This is valid for rc(r) <C 1. We obtain Vcond{T) = 
V + rgir) + O(r^) by solving the Gaussian integrals in 
Eq.HEl Here, g{T): 



7(t) = i/(c(r)|21og(j./i>)| - 7r/2T:c' 
7(0) = K|21og(i^/i>)|+7r/2) 



(12) 
(13) 



Fig-HIC) illustrates the dependence of Vcond{T) on Ts and 
V. Eg . [T^ implies that the spikes are typically correlated 
on a shorter time scale than the underlying MPs, due 
to the admixture of c"(r) which has a shorter time scale 
than c(r). For low rates, the contribution of c"(t) is 
negligible, but already at 20% of v the influence of c"(t) 
cannot be neglected leading to a sharpening of spike cor- 
relations. Notably, the spike correlations with temporal 
widths much smaller than the underlying voltage cor- 
relations have been previously observed in vivo[i>. 367 
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FIG. 4: Firing rate dependence of spike correlations for 
small r, theory and experiment. (A) Vcondij) — ys t and 
(i^cond(T) — u)/v YS T for V = 3Hz, Ts = 20ms; simulation re- 
sults are superimposed. (B,C) measured Vcond{T) — v ys. t 
and (vcondir) — v^jv vs. r for G {20, lOOjms; computed 
from pairs of patch clamp recordings. 
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FIG. 5: Difference in firing rate ieads to asymmetric spike 
correiations. (ieft) Vcondif) — ^V\V2 vs. r, simulation resuits 
and tlieoreticai second order prediction for r=0.2, ;/i=2.65Hz, 
//2=3-2.65Hz and rs=20ms. Arrows denote tfie peak position, 
(right) Vcondij) — \jv\V'2 vs. r. Experimentai resuits for = 
20, 100ms for different rates. 



in [^]. Eq. [13] also implies an increase of correlation of 
spikes with v (Fig. [1]B). However, the percentage of si- 
multaneous spikes {[vcontAj^ ~ is higher for lower 
rates, because at low firing rates {iI^q^ctv) the additional 
common component ndt) is more critical for reaching 
the threshold, than ni{t). g{0) attains a maximal value 
gmax='2vmax for the rate z^maa; = (27rTs)"i exp(7r/4 - 1) 
(Fig. [21 A). This simple model qualitatively captures the 
salient correlation peak for low firing rates recorded in 
neurons subject to weak correlated input(Fig. [5^0)), the 
presence of weak damped periodic modulation might be 
due to additional ion conductances of real neurons. The 
i^-dependence predicted by Eq.[T3|is also evident in Fig.[3| 
(B), even though vm — 9.4Hz escapes direct compar- 
ison (i'rn>£')- with increasing i^cond{^)—i^ increases 
and {vcond{Q) — is decreasing with v. Both re- 
sults are consistent with recent reports (Fig.lc in 5] and 
Fig.3(B,C) in U]). 

Rate asymmetry- The correlation matrix in Eq. [5] in- 
cludes c'(r), which so far did not enter Vcondij)- As 
c'(r) is an antisymmetric function it is conceivable to 
assume that a broken symmetry (y\ ^ vi) will lead to 
asymmetric Vcondij)- In the low r regime, we obtain 
g(T)=(y cond(j) — \/v\v-2)lr by solving the Gaussian inte- 
grals in Eq. I3I5I gir) then is: 

gir) = VI^(c(T)eie2 - 7r/2T| c"(r) - c'(t)t,A) (14) 
rpeak = T,A/(eie2 + 'kcS'^\Q)tII2). (15) 

where ei='ipQ/aVi and A=-\/7r/2(e2 ~ ei). The peak posi- 
tion is no longer at t=0 but is shifted to Tpcak- c'(r) leads 
to a temporal delay of spikes indicating that the spikes 
of the higher rate neuron precede spikes of the lower rate 
neuron, despite the perfect synchrony of the common in- 
put. The asymmetry increases with increasing diS'erence 
of threshold-to- variance ratios and increasing r^. The- 
oretically predicted asymmetric Vcond{T) (Fig. [5| (left)) 
is in good agreement with experimental results (Fig. [5| 
(top right)). Measured ycondiT) also shows an increase 
of the temporal shift with r^. This dependence is in 
qualitative agreement with Eq. 1151 despite the fact that 
experiments with 100ms escape direct quantitative 



comparison as i/m>£'~l-6Hz. Notably, shifted correla- 
tions are well known in the biological literature and are 
often interpreted as indications of synaptic connections or 
the presence of delayed inputs [T^. However, our frame- 
work reveals a potential mechanism for the occurrence 
of asymmetric correlations in pairs with synchronous in- 
puts 0. 

Discussion- We presented a framework for the descrip- 
tion of the auto- and cross correlations of upward level 
crossings with arbitrary functional form of input corre- 
lations. Our results confirm previous reports on the rate 
dependence of spike correlations 0, @|- This behavior, 
however, holds for weak correlations only. With strongly 
correlated inputs, spike correlations become independent 
of the firing rate but depend on the correlation time of 
voltage fiuctuations. In cell pairs with rate differences 
the temporal symmetry of spike correlations is lost. Fi- 
nally, let us stress that input correlations modeled in our 
framework do not imply a particular connectivity as they 
can arise from common input or reciprocal connections. 
Identifying self-consistent choices of c(t), r, -0o,i, <^v,i in 
a network of prescribed connectivity will be a fruitful di- 
rection of future research. 
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